3 Dimensional input device

ABSTRACT

The 3 dimensional input device that can input 3 dimensional object images that are mono-color, color, small, big, inside and outside. The device input multi-layers of 2 dimensional images in the different depths of field with varifocal lens. It registers colored 2 dimensional images, corresponding depths of 2 dimensional images and finds maximum contrast ratios of pixels in 2 dimensional images. Then the device to find out color, x-y and the depth of surface object, and thereof it finds out 3 dimensional information (data) of the object.

FEDERALLY SPONSORED RESEARCH

[0001] Not Applicable

SEQUENCE LISTING OR PROGRAM

[0002] Not Applicable

BACKGROUND OF INVENTION

[0003] 1. Background—Field of Invention

[0004] This invention relates to the image input & display devices,specifically to 3D scanner, 3D digitizer that are used for inputting the3 dimensional object or images, and 3DTV, hologram, stereo displaydevice that are used for displaying the 3 dimensional object or images.

[0005] 2. Background—Description of Prior Art

[0006] In the conventional way, it was difficult to scan 3D objectwithout projecting special beam like laser beam to object. In reality,giving laser beam is impractical if object is outside or big. Also,these devices are very expensive. Laser Design, Inc. (LDI) sells the 3Dscanner about $60,000, and Minolta sells 3D digitizer about $20,000each. This is not what many people cannot afford to scan 3D images.

[0007] The method to scan 3 dimensional image can be done in takingpoint clouds and convert to surface. U.S. Pat. No. 6,512,518 (2002)Demsdale, Jerry disclose this method. But this needs laser and takesonly-point clouds.

[0008] Also, there wasn't many 3D image input devices that cancompatible with 3D image display.

[0009] The method to project the 2 dimensional image to semi-transparentplates to create 3 dimensional image are difficult to show the 3dimensional virtual images in the space only by light. These are likeU.S. Patent application 60/004,111 (1995), U.S. Pat. No. 5,394,202(Deering) and U.S. Pat. No. 5,907,312 (Sato, et al).

[0010] In the Lab note made by Kazutora Yoshino (May 30, 1995), or inU.S. Patent application 60/004,111 (1995), or in U.S. Pat. No. 6,302,542(1999) shows that the movement of panel/screen with 2D image projectedon it can make 3D images. They don't show how fast the panel/screenshould move. They don't show mechanism how to move the panels/screenseffectively in order to make the 3D image realistic. Also, users cannottouch to the 3D image.

[0011] In U.S. Pat. Nos. 5,956,172 and 5,684,621 by Elizabeth AnneDowning, it shows the way to display the 3D image in a crystal. But usercannot touch to the 3D image.

OBJECT AND ADVANTAGES

[0012] This invention has advantages relative to prior art in

[0013] 1. The device can input 3D data without special beam projected onobject.

[0014] 2. The device can input 3D data in color.

[0015] 3. The device can input big 3D data,

[0016] 4. The device can input 3D data outside

[0017] 5. The device can input 3D data that can be easily convert to thedata for 3D display.

[0018] 6. The device can input 3D data reasonably fast.

[0019] 7. The device is relatively inexpensive.

SUMMARY

[0020] Recent development enabled to make fast process of data and fastvarifocal means. SONY developed fast varifocal lens using liquid crystallens.

[0021] An example of my invention is composed of a (computer) videocamera with high-resolution varifocal lens and computer to process thosedata are used.

[0022] General concept of this device is the following:

[0023] A1) First, input 2 dimensional images with different depth usinghigh-resolution vanifocal lens. (This can be done by one camera from oneangle, multiple angle or multiple cameras.) Register each value of focusor each position/length of motion of lens when inputting each 2dimensional image.

[0024] A2) Second, find out the depth at each pixel out of 2 dimensionalimages. This can be done in finding out the highest contrast point ateach pixel. In order to find out the contrast, it can simply compare thered, green or blue intensity value to its neighbor(s) red, green, orblue intensity value respectively. The biggest difference is the highestcontrast. Also black and white contrast ratio can be used as well.

[0025] Example formula for contrast is

Contrast=Absolute|G 1−GN 1| (It can be |R 1−RN 1| or |B 1−BN 1|);

OR

Contrast=Square (R 1{circumflex over ( )}2+G 1{circumflex over ( )}2+B1{circumflex over ( )}2)−Square (RN 1{circumflex over ( )}2+GN1{circumflex over ( )}2+BN 1{circumflex over ( )}2)

[0026] Where R1, G1 and B1 are the red, green and blue intensity valueof surface of object at the original pixel respectively. And RN1, GN1and BN1 are the red, green and blue intensity value of surface of objectat its neighbor pixel respectively.

[0027] This can be done in various methods:

EXAMPLE 1

[0028] i) at each pixel on x-y (in 2 dimensional image), find out thehighest contrast point to its neighbors in those inputted 2 dimensionalimages.

[0029] ii) the corresponding value of focus or position/length of motionof lens is the depth of the surface of object at each pixel.

EXAMPLE 2

[0030] i) At the first 2 dimensional image plane, register all contrastratios for all pixels.

[0031] ii) at next 2 dimensional image plane, if any pixel is greater,register as maximum contrast ratio at the pixel.

[0032] iii) repeat to ii) until the end of all 2 dimensional imageplane.

[0033] iv) the depth of the surface of object at the pixel is the planedepth of the maximum value. (The plane depth is registered at first whenthose 2 dimensional images are inputted.)

[0034] A3) Optionally, after 3 dimensional data is created, those dataare slice to outlines and send to display device.

[0035] This device can input (& display) the 3 dimensional objects orimages in real time (run time).

DRAWINGS

[0036] Drawing Figures

[0037]FIG. 1 shows the diagram of 3 dimensional input device.

[0038]FIG. 2 shows the diagram of image plane with original pixel andneighbors.

[0039]FIG. 3 shows the diagram of 3 dimensional input device and (2D/3D)display.

REFERENCE NUMERALS IN DRAWINGS

[0040] 1) The 3 dimensional input device

[0041] 2) a video camera with high-resolution varifocal lens

[0042] 3) high-resolution varifocal lens

[0043] 4) a computer

[0044] 5) object

[0045] 7) 2 dimensional image files

[0046] 10) an image plane with original pixel and neighbor pixels

[0047] 11) neighbor pixels

[0048] 12) an original pixel

DETAILED DESCRIPTION DESCRIPTION—FIG. 1—PREFERRED EMBODIMENT

[0049] A preferred embodiment of the 3 dimensional input device {1}. 3Dobject {5} is scanned by high-speed image input device means {2} withhigh-speed varifocal lens means {3}. The 2 D data and depth informationis transferred to driver and computer means {4}. Multiple 2 D imageswith various depth of field is captured {7} (It can be Multiple 2 Dimages with right focus with registered depth)

FIG. 2—ADDITIONAL EMBODIMENTS

[0050] A 2 D image {10} panel with original pixel {12} and its neighbors{11}.

FIGS. 3—ALTERNATIVE AND OTHER EMBODIMENT—AND EXAMPLES

[0051] A 3 D input device and 3 D display device

[0052] Advantages

[0053] This invention has advantages relative to prior art in

[0054] 8. The device can input 3D data without special beam projected onobject.

[0055] 9. The device can input 3D data in color

[0056] 10. The device can input big 3D data

[0057] 11. The device can input 3D data outside

[0058] 12. The device can input 3D data that can be easily convert tothe data for 3D display.

[0059] 13. The device can input 3D data reasonably fast.

[0060] 14. The device is relatively inexpensive.

[0061] Operation—FIG. 3

[0062] User can simply take the 3 dimensional image-object by the 3dimensional input device.

[0063] The rest is computer's work. Then 3D image come out to thedisplay screen, it can be saved to file for recording or it can be sentto proper location (like computer).

[0064] Users can command to computers by interacting with the 3dimensional visual image input like hand signals. Multiple users can usethese devices through networking like Internet as well.

[0065] Conclusion, Ramifications, and Scope

[0066] By this invention, users can input the 3 dimensional objects orimages, inexpensively, and such image (data) can be saved, transferred,or displayed for users.

I claim:
 1. Three dimensional input device means composed of the groupconsisting of i) High-speed two dimensional image input device means ii)High-speed varifocal lens means iii) Driver and computer means
 2. theinvention of claim of [1], wherein said High-speed two dimensional imageinput device means composed of the group consisting of two dimensionalimage input device, two dimensional image input unit, array ofphotodiodes or phototransistors, digital light processor units
 3. theinvention of claim of [2], wherein said high-speed varifocal meanscomposed of the group consisting of varifocal lens, mechanical varifocallens, liquid crystal varifocal lens, electro-optic varifocal lens,acousto-optic varifocal lens, piezoelectric varifocal lens, magneticfield driven varifocal lens composed of the group consisting of magnet,coil, lens
 4. the claim of [2], wherein said driver and computer meanscomposed of the group consisting of signal drivers, data transfer unit,data processing unit, software, software to find out the x-y and zinformation, computer
 5. Three dimensional input device means composedof the group consisting of i) X-Y finding means ii) Depth finding meansiii) Surface Intensity finding means
 6. the claim of [2], wherein saidX-Y finding means composed of the group consisting of two dimensionalimage input device, particle projection device and receiving imagesdevice, light projection and receiving images, visual, ultraviolet,infrared light projection and receiving images device, electron beamprojection and receiving images device, x-ray projection and receivingimages device, sound projection and receiving images device, ultrasoundprojection and receiving images device.
 7. the claim of [2], whereinsaid depth finding means composed of the group consisting of contrastfinding device, maximum contras finding means, parallax finding device8. the claim of [2], wherein said Surface Intensity finding meanscomposed of the group consisting of color intensity finding device,black and white intensity finding device, beam intensity finding device